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:54) IMAGE PICKUP AND IMAQE CONVERSION DEVICE 

;57)Abstract; 

PROBLEM TO BE SOLVED: To automatically detect the variation of a camera pitch 
^hgle from picked-*up lane marks and automatically acfiust a converted Image. 
S^OLUTION: The image pickup and image conversion device loaded in a vehicte and fixed 
an a posni C of height (h) and capable of picking up the Image pf a road surface on the 
3ack af ^ ve^hicte from a camera and converting the picked Mp image Futo a bN'^^-^eye 
mage detet^e lane mark« u pm^M Unes and Judgea whether the mark^ are 
jiaralTef Unea or not. When the fane mark& are ndt parallel llne^, the varbtidn dP of the 
camera pitch angle Pc is obtained irom width Wit on a posrtion most close to the 
i^ehicfe in the bird's eye image, width WI2 on a position most far from the vehicle and an 
angle P in the vertical direction of the camera in an area to be converted into thfe 
dtrd'S'-eye imase and Pc^dP la substituted for the camera pitch angle to prepare a 
aird'a^eye fmaf a ai^ln. 
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NpTIG^S * 

IPO and are m resigns i We f or afty 
jMijSiiB i^lM by tht of tjKU tmclatlm 

LTNs document has been trari'slated by computer. ;S^!ith^;tra hot /i'^flect the ort^^^ 

shows the word whi^h ash not be trantsfated. 
JJn the drawings, $ny word^: arie^ ftot transli^ed. 



'Cl^im:';t|>1i;!!i&^ fitt^gi^-^tH^lfji^ aiTOiidStfii^i'Jjfi^ p^ofe*nii>; dS*^i#^*K' Image 

iick"*up^ iff!;e||ii$ wNfoh sard jmagi^ ha5 babied ori the anafy^ls rei!i;^l| Qf S:Si^d imaf ja-^aiialyisfs ;mea and am 

jharacterfeed by to constitute so that the amended resolution picture may make output tn the image pick-up which ha6 an Image pick*^ 
ip means, an lmage-tran$formation means changes the image pick-up image of the image pick-yp means, and antpwt an resolution 
ilcture, and an fmage-^analy^^is means analyze said image pick-up image, and image-iJ^ansformatlon equipment;- . 
Claim Z] The image pick-up end the Image-transformatron equtprnent which amend tbe image pick'-up dinaction parameter of :the image 
lick^up means which said image^transformatibn m^ has based ph ihe analysis result irrta^erliSiiyafs arid arife: 

:haract«H^d <?<>»^stftytih^ IP that the aiiii€ihdisfd i^§qIu Picture may meke but!^ti| ftj t^ iwage pte^tf^^^ 
neans; ■ ^n^vfFTi^ j;e^ 

md m imag^i^^iys pei^^SSoft;--^ 

Claim 3*] Said im^age pick-up me#nis t$ the lm4g6^•^i.iek'-up aocordihg to- claim 1 6r'2Wd"-in(Ti'ag^^^ 
sharaoterized by being attached in a car and mainly picturizing a road surface. 

Cfaim 4] ^aid image analysis means ie the image pick-^up according to cfalm 3 and image transformation equipment which ^re 
characterized by determining the amount of amendments of said Jmege pick-up direction parameter by preepmin^ end extracting the 
ranallii flh^is br tjiS dn at rbiiS isiui^kc sbict ahal^feg the irn^ige picfc^up irV^ r^bfiiiitibh pfc^Mii^ i^tW^6;p^ 

nes or a known graphic fbr^^ 

O^aim 5] S^|d irhage eniaiysjs m is the image pick-up a^ording to cJeim 3 and image transfbrmatiph equip 

sharnSiEGteHzed^ of said image pick-'up direction parameter by the rate mea^uremeiit means of 

I car betng interlocked with by analyzing the image pick-^up image or resolution picture of an optical flow on a road surface. 
GfaiM 6jf£ %e M cfaim 3 artd image transl^rm^tioh exjMJpfnent which are charactenzed by deterrnfntn^ the 

imbunlt: pit ^rini0h|c;itir>aht^ pf e|if4 ^^^d^ picit'-up dJrbctlpjrt paraiti&tier by anatyzing the re:so(Mtion picture having preijeteriTiirf^d distance. 
irrahgniFig itwb or more of said iHiag^^^ plbkrup ime0ns, and according to the iitiagie pick-up image of the imag^, plck-niip means cf these 
ilurallty [ means / said / irhage analysis 1, or sard image transformation means. 

Claim 7] Ar [mage piok-up and image trandbmiation equipment given in any 1 term of claim 3 characterized by fer attitude-sensing 

leans to detect the direotipn of m irnage pick-up means being arranged by said image pick-up means, using tpgether the direction 
larameter of the imaife pick^MP meane against the car which this attitude-sensing m^ans detects, and determining the amount of 
mendmenrts bf said Imikge pick'^up direction parameter thru/or c\mm 6. 



Translation done.] 
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JPO mi tN^IT are not responsible for an^ 
d8j»«9i»s caittsed by the use of this translat^oa 

1. Thfis dbdumeht has be^n ti^^ngl^ted £>y g{>^ So the trafil^latioh may fHat r^fl^dt the drtgEhal pr^cisety. 

2. ***^e shows the word which can not be translatsd. 
SJn the cffawingjSi any words are not translate^d, 



[Detalfed Description of the Invention] 

ilField of the jnyentipn] This iiiy relates to the image pick-*up and image transf^^ equipiTTent vvhioh 

3ictum::fh^^^^ pick-Up iiiiit^^^ by the jitt^e pick--up;:iinifa'n ain Jitt^^'tj^ ; 

kom "iki'w^t n^Ari b&f^r^'d'uSiJtitehg to %t^^kdmh'. =irttei(g:*>*b(ijgS^^ thl<t in!i^S:ftSiciii:ii ^S!#^1l^w^:iS=^^^ 

Dick-up which pr&Vfdes ah operiStbr ete wl^h the to^^^ part ih opS:«^ ^ 

(/essel, the afrcraft, etc., and external observation especially, and especially image transformation e<jMipm^nt 



[Description of the Prior Art] For example, JP,29467^7,B and JP,7-218280,A are known as the image pick-up which picturizes the road 
surface and t^ad situation of the front or back to the operator of a car, and prepvides him with the top View (b W^igf^iye view) ^^^^ 
jpper R^aj^^^ imag!^ Jtr^hj^^^ eq^]p;ment Th^s^ fJ)^ image pick-nip eqMfpm^ a$ a design INJu-cJfng tf?e jini^fl direction 

aetbrefiShi ahd injsui tlie pai*Bm0t:&r. 



problem(s) to be Solved by the Invention] Like a passenger car, by a car body's sinking or inclmmg with the entrain ment number and 
:he amount of bads, when the location and the imege prck-njp direction of image pick-up equipment d [filer from the parameter inputted 

it wais designed, in a place, they may happen frequently. Then, while running the road surface which has completely parajlel lane space 
Tiarks, for example, even if it is going to obtain the top view (bird's-eye view) from the upper part fr6m an image pick-up and image 
u^arvsfprmation equipment, distprtion will arise. 

;0Qd4].Thia Is shown in dravtfing S . As shown in (a) of drawing 8 , when, the pitch angle Pc (the apparent vertical passing through the lens 
sore bf p^amera 0 ari^d angie which the image p^Gk^^{p direction of a camera constitutes) of th« camera C formed in Gar M Is alpha, th^ 
mage pick-'up image ((b) of drawing 8 ) preisuppdses that the processor is constituted so that it may become a right resolutfon picture 
"(o) of drawing 8 ). That is, when th« parafJei lines on a road surface (a thick segment and broken fine) are picturized, an resolution 



picture presupposes that it is actiusted so that it may become parallel fines. When the pitch angle of a camera becomes targe with 
1 slpha-^d aipha (dalpha> 0) or becomes small wl#i alpha-d alpha (dalpha> 0) at this time, that image pick-up image becomes like Cd) of 
jrawing 8 , (a horizontal line H becoming a low location among an image pick~up image), (eX and (a horizontal line H becoming a high 
ocation among an image pick-up image). Then, since the approach of image transformation is to change into the frame of the screen of 
c) of drawir^ $ , (f), and (g) the freld surrounded by the dotted line of (b) of drawiilg B r (d), and (e), the resolution picture of (d) of 
Jrawing 8 and (e) will become like (fi of drawing S , ahd (g). That rs, an resolution picture did not becom'e a top view (bird's-eye view) 
Tom the right upper part with the inclination of a car, but Itiere was a problem that right informatign was not directed to an operator 
5ven if It outputs to image recognition equipment. 

"0005] Accomplishing this invention in order to solve the above-mentioned technical problem, the purpose is offering the image pick-up 
md image transformation equipment which were constituted so that the resolution picture amended by carrying out automatic 
amendment of the image pick-up direction of image pick-up equipment might be outputted. 

:ooo63 

!Means for SoK/tng the Problem] In the image pick-up which has an image pick-up means, an image transformation means to change -die 
mage pick-up image of the image pick-up means, and to output an resolutbn picture, and an image analysis means to analyze an image 
>ick-up Image according to the means according to claim 1 in order to solve the above^-mentioned technical problem, and image 
ransformation equipment It is characterized by constituting so that the image pick-^up direction parameter of the image pick'-^up means 
vhich an image transformation means has based on the analysis result of an image analysis means may be amended and the amended 
esolution picture may be made to output. This is shown in drawing 1 (a) as a block diagram. In addition, as an image pick-up direction 
larameter, they are the locations (camera height etc.) of an image pick-up means, the angle (pitch angle) of the direction of an image 
)ick-up core, and the straight line taken down downward [ vertical ] fi^om the image pick-up means to accomplish, the angle (horizontal 
Sure angle) of those fiat surfaces to make and the direction of a setting Image plck'^up core set up to accomplisK end angle of torsion 
rP the image pick*-up means centering on the direction of an image pick-up core, 

'0007] Moreover, an image transformation means to change the image pick-up image of an image pick-yp means and its image pick-up 
neans according to the means according to claim 2, and to output an resolution picture, In the image pick-up which has an image 
inalysis means to analyze the resolution picture which the image transformation means outputs, and image transformation equipment It 
s characterized by constituting so that the image pick-up direction parameter of the image pick~up means which an image 
ransformation means has based on the analysis result of an image analysis means may be amended and the amended resolution picture 
nay be made to output. This is shown In drawing 1 (b) as a block diagram. In addition, as an image pick-up direction parameter, they are 
he locations (camera height etc.) of an image pick-up means, the angle (pitch angle) of the direction of an image pick-up core, and the 
straight line taken down downward [ vertical 3 from the image pick-up means to accomplish, the angle (horizontal Bure angle) of those 
]at surfaces to make and the direction of a setting image pick-up core set up to accomplish, and angle of torsion of the image pick— up 
neans centering on the direction of an image pick-up core. 

^0008] Moreover, according to the means according to claim 3, in an image pick-up according to claim 1 or 2 and image transformation 
equipment, it is characterized by attaching an image pick-up means in a car, and mainly picturizing a road surface. In addition, a road 
surface is not limited to the so-called road, but means^all the fields where a car moves. That is, a parking field is included 
!0(K)S] Moreover, according to the means according to claim 4, an Image analysis means presumes and extracts the parallel lines or iiie 



X)oaa] 
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known gi'aphic form on a road surface, and is characterized by determining the amount of amendments of the Image pick-up direction 
parameter by analyzing the image pick-up image or resolution picture of these parallel lines or a known graphic form. Road surface-like i 
parallel lines mean the road shoulder, lane space marks, a parkrng fietd partition line, ete», and a known gfaphtc form means road surface H 
dispplay of a circular manhole, a stop line, and a travelling direction and others etc. here, for example. 

[001 CQ ^4oreove^, according to the means according to claim 6, an Image analysis means is characterized by determining the smount of 
a^neap^dmsntB of th* immm plckr^ dlr^cjtJon pammetsr by the rate medsui^fertrortt mesns ©f a oar bSlrig; Hiti^rl«*oki&d V!/^ aiiieiryzing the f i 
ffwe^ge jair©k-up tmefgi or r^oltitlon ^►(eture of ah optii&al tow i£jn ^ t&^4 6Ui^c0. An opttei&l fl<i>iitf riifefihe v(*^^ reo^ii?ife$id:i^^ tJiie: r«^^« 
analysis means as what moves in an image pick'^up image or resolution picture top here like the tene space marks of the shape of a 
broken I if^e formfeif in the road surface 

[001 13 Moreover, according to the mesns according to claim 6» It has predetermined distance, two or more image pick-up means are 
\ arranged, and an image analyses means is characterized by determining the amount of amendments of th^jtwagqi ptisk-^t^-^ifrf^^ltsrie^jli 
parameter by analyzihg the rmage pldk^up image of the image pick-up means of these plurality, or tlie resolution picture by said image 
transformatiiiil' R)i<e^ns. 

JQQI?] ^r«sMpv^r, acc^r^nf to th^^ m^an^ a?fcor4lng; to claim 7, it is characterized by for an ?ri^it^^do-sfl^ tp thj& 

liif^otldn of^ 4n fmag^ pl^ the image pick-up rinesns, using together the difietrbn paraTnetetr of the image 

Dtok^up means against the car which thrs attitude-sensing means detects, and determining the amount of amendment? of the image 
jfck^up dfe the combination and others of a gyroscope, an acceleration detector, 

[Function and Effect(s) of the Invention] When the image pick-up means has not turned to the image pick-mp dfreotjcfR a s^irig. it 
san ask for the gap with the set poirrt of the image pick-up direction of an image pick-up means by analyzlii^ Sin fMai€J j>fOk-up image or 
in resoJwtiofi picture with the means of claim 1 of: this appitcation, or claim 2. Therefpret the amended re=s<)iutton picture can be acquired 
jy arhendrng the image pick-^up direction parameter in an image transformation means, without ecyustlrigthe im^ge pick--yp m^ans itself. 
fherefore. frne tuning becomes unnecessary in the case of immobfll2ation of an Image pick^-up means. As such an image pick-up and 
mage transformation equipment, after picturizing a road surface eta astant, for example, it is effective in especiafty the image pick-up 
md Image transformation equipment that form the top view (bird's-^eye view) from the upper part. By this, you can make it for example, }) 
mage recognition equipment interlocked with, a more exact circLimference situation can be recognized, and circumfarenee status 
nformation can be given to an operator, a monitor, etc. 

;O0143 If an imagie pick-up means is attached in a car and the image piok-up image or resolution picture of a road surfece is analyzed, 
he amount of amendments of the image pick-up direction parameter can be determined easily (claim 3). According to analysis of the 
>arallei lines on a road surface, a known graphic form, and an optical flow, it is especially easy and certain {claims 4 and 5), If two or 
nore image pick-up means are established, the image pick-up direction can be certainly determined from a stereo image, and the 
imendment is also easy (ciaim 6). Amendment will become still easier if it has the attitude-sensing means of the image piok-up means 
tself in addition to these (claim 7). 

^001 5] Oomblhing claim 1 and claim 2 of this invention is also inciuded by this invention. That is. It has the Ist image analysis means 
vhich analyzes an imago pick-up image, and the 1st image analysis means which analyzes an resolution picture, 1 or two or more image ■ 
jick-up direction parameters are amended based on the analysis resuH: of the 1st image analysis means, and 1 or two or more image 
)ick-up direction parameters are amended based on the analysis result of the 2nd image analysis means, analysis of an image pick'-up 
mage — the decision of the amount of amendments — • 1 [ easy ] or two or more easy image piok-up direction parameters, and analysis ,;: 
)f an resolution picture — the decision of the amount of amendments — it asks for 1 [ easy ] or two or more easy image pick-up 
iirection parameters with the 1 st image analysis means and the 2nd image analysis means, respectively. Thereby, the amount of 
tmendments can be determined easily. 

0016] Moreover, combining claim 4 thru/or claim 7 of this invention is also included by this invention. For example, about a thing like 
fuctuation of only camera height which causes only fluctuation of only a scale of an resolution picture substantially, the amount of 
imendments is calculated from relation with a car rate with the means of claim 5, and the other image pick-*-up direction parameters are 
imended by claim 4. Moreover, for example, a gyroscope is built into an image pick-*up means as an attitude --sensing means of claim 7, 
rom image analysis like angle of torsion, amendment of the difficult image pick--up direction parameter Is enabled, and claim 4 or claim 5 
imends the other image pick-up direction parameters. In addition, any combination of claim 4 thru/or claim 7 is included by this 
iventlon. 
0017] 

Embodiment of the invention] Hereafter, the concrete example of this invention is explained Although the foik>wing examples are 
ixamples including amendment of a pitch angle, they are taught by the following example and other configurations of the invention in this 
ipplication can constitute them easily. 

0018] The [1st example] Drawing 2 is the block diagram showing the configuration of the image pEck--up concerning the 1st concrete 
xample of this invention, and image transformation equipment 10. As shown in (a) of drawing 8 , it is carried in Car M, and the camera C 
jhich pictunzes car back is assumed The image picturized with the camera (image pick-up means) 1 of drawing 2 is inputted into the 
lew transducer (image transformation means) 2. Here, it changes into a bird's-eye view image based on the image pick-^up direction 
arameter which Is a initial value. Here, a bird's-eye view image is outputted to tiie image analysis means 3. The image analysis means 3 
onsists of the lane-^space-marks detecting element 31 and the amount calculation section 32 of parametw amendments. In the lane- 
pace-marks detecting element 31, the lane space marks which rt should display as an parallel white line are detected. Here, tane space 
larks did not become a perpendicular parallel track group among the image, but the inclination may have arisen. Next, in the amount 
alculation section 32 of parameter amendments, when the inclination has arisen in lane space marks, the amount dP of amendments of 
he pitch angle Pc of a camera 1 is computed, and ft outputs to the view transducer 2. The view transducer 2 performs image 
•^ansformation agafn based on the amount dP of amendments of the pitch angle Pc of a camera 1. In this way, it is outputted, after 
speatrng a routine and becoming a right bird's-eye view image until the inclination of the lane space marks which it should dispby as an 
arallel white line in a bird's-eye view image is lost 

D019] An image pick-up and the image transformation equipment 10 of this example make a flow chart the procedure performed as a 
fhole, and rt is shown in drawing 3 . SI, S2, etc. and existing "S" mean the step in a flow chart. By SI, the image which the camera 1 
icturized is captured first. Next, by 82, view conversion is performed using the image pick-up direction parameter. Even this is an 
peration of the view transducer 2. Next, two lane space marks are detected from a bird's-eye view image by S3. Next, by S4, width of 
ace Wit and Wi2 of two places of fane space marks is computed Next, the difference of width efface Wil and Wi2 is searched for by 
;5. If it becomes WJ1=Wi2, it wil! progress to S6 and a bird's-eye view image will be outputted. If it becomes Wil !=Wi2, since there is an 
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ndinatidh of lane space marks, it progresses to S7, and the amount dP of amendments of the pitch angle Pc is computed, it progresses 
:o SB, the pitch angle Pc of the image pick-up direction parameter is replaced with Pc'*'dP, and it returns to S2, 

,0020] The approach of computmg the amount dP of amendments of the pitch angle Pc of a camera 1 from the inclination of the lane 
space marks of a bird's-eye view Image is as follows. As shown In (a) of drawing 4 . the foot of perpendicular taken down to the road 
surface G rs set to G1 from liie camera C formed tr height h, and the range Included In a bird's-eye view image is carried out to from G1 
:o back G2. The magnitude of angle G1CG2 \s placed with P. Moreover, as shown in (b) of drawing 4 , points R1 and R2 «re assumed 
Tom a point G1 and a point G2 to G1G2 in the location ofihe perpendicular this sMe W, If the image pJok-up direotion parameter of the 
/lew trans<iucer 2 of drawir>g 2 Is In agreement with the actual Image pick--up direction parameter of the camera G of drawing 4 , die- 
en^h J(G1) ] (R1) and ICQ2) \ (R2) are equal about the corresponding points I (Ql). I (Q2), I (Rl). and I (R2) in the bird's-^eye view Image 
3f points G I , G2. Rl . and R2. 

;0021] Next, the case where the prtch angle Pc of Camera G shifts dP is assumed namely, (a) of drawing 4 — like — the angle Ql of 
nagnitude P — 'CG2' — angle G1 — It is assumed that only CG2 and dP shifted at this time, as for the fiefd of the square drill 
mirounded by angle 01 0R1 of magnitude theta 1, and angle Q2CR2 of magnitude theta 2, the prtch angle Pc of Camera C shJfts dP — 
Jie angle G1 of magnitude theta 1 — 'CRI' and the angle G2 of magnitude theta 2 — it changes to the field of the square drill 
surrounded by 'CR2'. The following relation will be realized If it sets here with G1R1=G2R2=W, GrRI* =W+dW1. and G2'R2' =W+dW2. 
Equation 1] 

W^himff^ — (1-1) 

^^^^^ -(1-3) 

0022} Here, If dP rs small enough, it can set as follows. 

Equation 2] 

coBdP^ 1 (2 - 1 ) 

w(P+dP)= cosjP- slnPrfP —(2-2) 

I 0023] dWI and dP can be calculated as follows using a formula (2-1) and a formula (2-2) from a fonnula (1-1), (1-2) and a formula (1- 
j i), and a formula (1-4). 
Equation 3] 

\ W^^O (3-1) 
5 L_ ,„ (3-2) 

W+dW^tBOLP 

0024] Now, It thinks of what since these are tiie relation in a real-image system, has happened to them by the bird's-eye view image, 
rawing 4 — ( — c — ) — like — a point — G — one — ' — G — two — ' — R — one — ' — R — two — ' — a birds-eye view — an 
; nage — corresponding points — I (GV) — I (G2') — I (R1 ') — I (R2') — ******** — die-length KGD I (RIO and KG20 I (R20 — being 
quel . now, segment G2'R2* of real-image system top — Point r — G2' — if it takes so that It may become r=s=W. corresponding-points 
in the bird's'-eye view Image of Point r ] I (r) is located on segment I(G2') I (R2*) in a bird's-eye view image, completely — being the 
ame — things — a point — R — one — R — two — R — one — ' — R — two — ' — r — a straight line — G — one — G — two — 
xiai symmetry — a point — L — one — L — two — L — one — ' — L — two — ' — I — ******** — carrying out . Then, when the 
me space marks of two parallel straight lines of width"-of--face 2W of the straight line which passes along Points Rl, R2, and r, and the 
tralglit line which passes along Points LI, L2, and I are assumed, it is clearer than a formula (3^1) point RV and that point L1"s it is on 
ine space marks respectiveiy. Therefore, lane space marks like the thick wire of (c) of drawing 4 can be assumed. 
D025] Like the already described JP,2946727,B publication, a bird's-eye view image changes the image pick-up image of a Gaussian 
naging system, and its ratio of the segment in the bird's-^eye view image corresponds with the ratio of the segment in the real-image 
ystem fn the direction of an axis of abscissa (it is the direction of [ on a perpendicular road surface ] to the image pick-up center line 
f a camera). Therefore, the ratio of dW2=:rR2' of a real-image system and G2*R2' =W+dW2 Are equal to the ratio of l(r) I (R2') in a 
Ird's-eye view image, and I(G2') I (R2'). I(R2') KL20-I (r) It is equal to the ratio of I (IX (=2I(r) I (R2')), and I(L20 I (R2') (=2KG2') I (R20). If 
sets with I(L2') i{R2') =I(Lr) I(RI ') =Wi1 and I(r) 1(1) =Wi2. the formula (3-2) of a real-image system can be replaced by the fonnula (4) 
I the following bird's-eye view image. 
Equation 4] 

1aiil> 

)026] The place which a formula (4) means Is clear. That iSt in the lane'^space-marks detecting element 31 of the image analysis means 
of drawing 2 , Bure dP of the camera pitch angle Pc is called for from the width of face Wil in the car nearest to the inside of the 
ird's-^eye view image of the lane space marks which continue the detected bird's-eye view image from the car latest to a back distant 
lace noting that it is the lane space marks which should be parallel lines, the width efface Wi2 in the method of the last in a faird's-oya 
iew image, and the image pick-up angle P of the iengtiiwise direction incorporated as a bird's-eye view image in a real-image system, 
herefore, a right bird's-eye view image can be obtained by transposing the camera pitch angle l=*c to Pc+dP among the image pick-up 
irection parameters, and perForming view conversion again, without correcting the image pick-up direction of a camera itself. 
)027] The [2nd example] Height h of Camera G considers the case where it changes to h+dh. drawing 4 — setting — ** — the image 
ick-up angle P of the lengthwise direction similarly incorporated as set-iip camera height h and a bird's-eye view image as shown in (a) 
F drawjng 5 is set up. The same is said of points G1, G2, Rl, and R2, dieHength W, and angles thetal and theta2. next — drawing 5 — 
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7*'b — y-r— like — height — h+dli — a point — C — ' — having become — the time — magnitude — theta — one an angle — G - 
■ one — C'R — one — ' — becoming — a point — R — one — ' — a point G — one — ' — dfstance W-i'dW — one — 
nagnttud^ — theta — two — an angle — 0 — twQ — C'R ^- tWQ — ' — bec^mmg — a point — R — twQ — " a pspint ^ Q — two 
■- ' — Ss^tmoe ~ )Ni^^i — {jtaaihi; . Thi&n, tb«.foBowing relation Is^ realked clearly, 

0028} The feUowing relistion consists erf a formula (5^1) and a farmufa (5-3). 

il'-^iiiii^^iiiiiiiiijii^^ 

0029] If a formula (& is substituted for a formula (5-4X it will become as follows. 
Equajtjon 7] 

h^m)Wi0^^W^dW^ (7> 

30303 A o<«tiparisoii of s formute C5-2) am* & formula (7) materialized the foflowlftg formula. 
« 4VSr^ ( 8 ) 

D03t3 From a formufe (SX even if a camera moves to point C of height h+dh from the point 0 of height h* being maintained by the 
ird's-^^ Vbw ima^e tm und'orst^nd parallel of lane space marks easily. Therefore, it can ask for the change dh of the height of a 
ami^ra by the following approaches. 

3032] Suppose that the lane space marks which described the slash disappeared from the blrd's-^eye view image after time amount t as 
hown in (d) In a bird's-eye view image which is (c) of drawing 5 , If the image analysis means Is bejng interlocked with the rate 
ieasurem(3rrt means ofst carhera, the distance D which progre^s^d between time amount t will bo found. On the other hand, since the 
sclude angto of a 44&n£thwf«e direction of the range changed kite a blrd's-^eye view Image among: the Image pbk^up range of a camera 1$ 
\ h+dh, #ten its distance are cosP(s) <h+dh) about height. It can opt for the fluctuation dh of a camera locatfon from the distance (h-»"dh) 
» and oosP which progressed between -dme amount t. In this way, a right bird's**eye view image can be obtained by repeating asking for 
bird's-eye view image again by making a camera location into h^-dh. 

30331 The [3rd example] The parameter decision tn an image plck-*up image is explained briefly. Fcr example, suppose that the image 
ick-yp H of a hon2:ontaf line Wds detected in the Image p'rck^up tm^e. At 1^is time, if the lmeg;e pick-up H of e hori;tonfce[ Ikie i$ level a& 
hown in (a) of drawin 
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\ IftaiaiKes eau^eii by tbe iisn of thi s translat ion. 

I. This document has been translated by computer. So the translation may not reject th^ original precisely, 
i shows the word which can not be translated. 

I lln the drswfngs, any words are noft transtated 



Field of the Invention] This invention relates to the image pfok"up and image transformation equipment which ch^njge Intp an resolution 
*f^jtur^tbe Imagi^ prok-up image piotur^l^ed by the Image pick-up means with an image transformation means, and output it. What 
ihang^s ttie in^^ge prnk^up mf$,e speoffi^alfy obtained by pictwH^ing a roa^ syrfaoe ^t<?.^ a«lant into the^ tpj^ pk^un^^pk and fbtain^^d 
rom thfe v^p^per part before outputtlng^ to fi&r eitamplei imaga racoghitfeh a-cjuipment ia riiiiitlofK^d Thfe lriv;antbri Is afF^ctiVe iri ihi Image 
dok-'up which provides an operator etc. With the top vtew Cbird*S"eye vr^w) from tha upper part rn operation of operation of a c^ar etc., a 
^essel^ the aircraft etc^ and external observation espeoially, and especially image transformation equipment 



Tranal^tion done J 



j * NOTIOES * 
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I 2.^*5*** shows the word which cart not be translated. 

i RRfORART 



[Description of the Prior Art] For example, J:P,2946727,B and JPy7-218280,A are known as the image pick-up which pioturi^as t^e road 
j surface and road situation of the front or back to the operator of a car, and provides him with the top vrew (bird's-eye view) from the 
i upp^r part* and Image transformation etquipm^rrt Thesa fix tmage pick-up equipment as a desFgn inojudtrig the image piok-gp cllreotion 
I beforehand, artd input the parameter 
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Function and EfFect(s) of the Invention] When the Image pick-up means ha^ not turnecJ to the image plck-^up direction as a setting, it 
im ask for the gap with the set point of the image pick-up direction of ah fma^e pick-up rrteans by anafyzmg an image pick-^up imSgi^ or 
in resofgtion picture with the m.e^ns of claim 1 of this application, or qiaim 2^ Therefore, the amendeei resolution picture can be.a^sQiy^ired 
yy amending the image pick-up direction parameter in en image transformation means, with.pyt adjusting the. imag® i^'^^^^P ^^W^ f^^self. 
"her^fore^. Ii^fe tuF)ir^ beooFrtes umeees^ary rn tl^^ ^da^je: of liifimobiiiiatipn of an Image pJckrup itiean^u As such an image pi^k-jU!? ain^f 
rage transfdrmieition et^uipm&ittra^ road etfffaoe etc. a[siantt fbrex^mpbi it 1$ effeotiye in eepecie^ty Image plcfir!^. 

hd image transformation equipment that form the top view (bird's-eye view) from the upper pistrt. By this, you can make \t for exampj^f ■ 
nage recognition ec|uipment interlocked with, a more exact circumference situation can be recognized, and circumference status 
iformation can be given to an operator, a rnonitor, etc, 

0014] If an image pick-up means is attached in a car and the image pick-up image or resolution picture of a road surface is analyzed* 
he amount of amendments of the image pick-'up direction parameter can be determined easily (ofaim 3X According to analysis of the 
araile} lines on a road eurfaoe^ ^ known grai^hle formj ^f*^ an optica) flow^ it \k especi^aiffy e$sy ^d eert^in (ef^imfs 4 and Si). If two or 
ibre im$ge pickup meahe am est^bi^Had/t^ imags jiilxirk^^ direoitfm dm bd:&ertdfr^V :deit^m a stir^b image^ and tjie 

mendment ie also easy Cclairri 8X Amendment will become still easier if it the atdtu^d^-^sensing means of th^ lmage^ ^^^^^^^^ 
.5elf in addftion to these (claim 7). 

301 5j Combining claim 1 and claim 2 of this invention is afso included by this invention. That is, it has the tst image analysis means 
rhioh analyzes ah image piok-^up images and the 1st image analysis means which analyzes an: resolution picture, 1 or two or more image 
ick^up directlbh pairatri^t/^s^ based on the analysis result of fee Tst Im^ge anaiysis i*n^ iiri^ge 

tck^P direction p^ran^eters b the arsslysis result of the 2nd im^age ahaiy^is mean^; andyisi^ of an imege pic^k'^t»(> 

nage — the decision of the ameM^t of amendments — 1 C easy ] or two dr rnore e^ey im^jg;^ l>i<^^ analysis 
f an resolution picture — the decision of the amount. 6f a^m^ndm^rtta — t it asks for 1 [ easy ] or two or more easy image uick-up 
irectbn parameters with the 1$t image analysis means aindthe 2hd image analysis m^ms, respectively. Thereby, the amciuntDf 
niendments can fee d^^ 

Mc^reoyer/ cpmk olaim 4 thru/or clafm 7 of this invention is also included by tJiis invention. For example^ about a thing like 
uctuation of only eamera height which causes only flLictuation of only a scale of an resolution picture substantlefeify, the amoMnt of 
pnendments is caicutated Ironi rela^ a car nate with the means of claim 5» and the other image pl^k-up^^ t^^^ 

mended by cteim 4, fi^oreoven for examjpie^ a gyrosoope is btiift mto an image pfckr-up means ^ni^ltit^ 7, 
'om ImiNEe an#ysjs lij^e an^t^ of toi'eldn^ arn^h^^Pent of the cfifRoMlt imaige p^lok^^up cllrecti^n p^friiar^^^ ot^irti 4 or dlalm 5 

mends the other tmagie pick-up diire^'tion parameters* In addition, any oomblnMioh cpf ofairn 4 thru/or elaiim 7 Is ihcfud^^tf by this 
ivention. 
3017] 

Embodiment of the Invention] Hereafter, the concrete example of this invention is explained. Although the following examples are 
xamples including amendment of a pitch angie« they are taught by the following example and other configurations of the invention in this 
pplication can constrtute them easily. 
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FECHMieAL-Pft'dBLEI^ • • 

I probl^mCs) to be Solved by th^ Invention] Like a passenger oar, by a car boidy's sinking or inclining with tb^ e^ntrainment numbesr and 
he amouRt of foads, whert the looation and the imag^e pick--up direction of iftiage piok^up eQiiipment differ from the parameter inputted 
sr it w^s d^ssignad* in a pface^ they may happen frequerrtly. Then, v^fhile rurtnir>g tb^ road surface wiiioh hm Qompietety paraiJel isn^ sp^^ie^ . 
na rk^, for exampfe^ eveo if it is. going to obtain the top view (bird*e-*-eye viw) from th^ upper part from an Imag^ pick^uf^ ar»d Ima^e 
rans-formati^oi^ equipment, distortion will ari$e, 

00043 This Is ^hown in drawing 8 . As shown in Ca) qf drawing .8 , when tha pitoh angle Pc (tl^e apparent vertjoai parsing through the len^ 
jore of Camera C and angle which the image pick-up direction of a camera constitutes) of the camera C formed in Car M is alpha, the 
Tiage pjck-^up image ((b) of drawing 8 ) presupposes that the processor is constituted so that I't may become a right resolution picture 
(o) of drawing 8 ). That isr when the parallel lines on a rpad surface .{a thick segment a^nd broken fine) are picturized, an resolution 
ricture presupposes that it is adjusted so that ft may become paraiJel fines. When the pitch angle of a camera becomes large with 
ilpha-'^d alpha (dalpha> 0) or becomes small with alpha-d alpha £dalpha> 0) at this time» that image pick'-up image becomes itke (d) of 
ii^^^iPiP: . <a hori^ont^i Wrm H becoming a i^w locatlop among an image pick-up image), (e), and (a hoHzontal fine H becon^mg a high 
Msatten among an iir^ge pick-^jp image). The-n, stirce the approach of image transformation is to change Into the fram« of "-die screen of 
c) of drawing § . Cf), and Cg) the field surrounded by the dotted line of (b) of drawing 8 . (dX and (eX the resolution picture of Cd) of 
irawing 8 and (e) will become like (f) of dtawmK 8 , and (gX That is, an resolution picture did not become a top view (bird'$-eye view) 
rom the right upper part with the inclination of a car, but there was a problem thait right irrformati'on was not directed to an operator 
tven if it outputs to image recognition equipment; 
i 0005} Accomplishing this invention in order to $Olve the above-mentioned technical problem^ the purpose is offering the image piak-^up v 
I ind image transformation equipmenst which were constituted so that the resolution picture amended by carrying out automatic 
; amendment of the Image plclcryp Erection of image plck*up equipment might be outputtad. 
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, \Ems 

Vleans for Solvirijg the Problem] In the image p\ck-up which ha^ an image pjck"'Up means, an image transformation mean^ to change the 
I nage pick-up Image of the image pick-up meafts, and to output an r@sQlutf<?n ptoture, and an image analysis means to anaty^e an image 
j iok-^up imafe according to the me^ns atooordlftgS, to olalm 1 in order to ^Ivfe the abovfe^n^erttioned teohniosi problem^ and image 
1 ^anefermetbn essfuip^ent It dhe^PatterlSfced by oonetitutins «o thiat the im^^e f^iok^p drr&^Jition ^^m^^ter of the ^mage pi^H^PP tn«^n^ 
i rhich an imisge t^^isfdrmatHoh unii^ basi^d an th^ an&ly^isi result of m il^ge s»rf^lv^!& Hia^ m mehcted iftrifit th^ai l^e«!),<tod 

ssolution proturo may be niad«9 td outijut This re sHown in drawing 1 (a) as? a block diai^rtoi. Tit additro^, an^ !m«ie pbftHij? di^'^ctiiSM^ 
aranieter, they are the locations (camera height etc.) of an image plok-up means, the angle (i^itoh angte) of the dfreotlon of an image 
iok-yp core, and the straight line taken down downward [ vertioal ] from the image pick-up means to acoomptish, the angle {horfzoirtat 
lure angte) of those flat surfaces to make and the direction of a setting image pick-up core set up to aocomplieh, and angle Of tOrsion 
f the Image pick-up means centering on the direction of en image prck^up core. 

3007] ftrforeover, an Image trransformatlon means to change the intage pick-up image of an image pick-up means and its image piofcmp 
. Yi&m^ a*3iOording to the meane\aoo0rdfng to oteim 2. artd c^wtpt* an re^oitrtion i^i^Jture. In the image pSok-w^ whteb ha,* an image 
naiysfs means t&t analyze the; resolution pTcture which the image tMn^termatitm means outputs, add image trenfafermatron eciuiphient It 
i characterized by constituting so that the image pbk--up direction parameter of iiie image pick-up means which an image 
'ansformation means has based on the analysis result of an image analysis means may be amended and the amended resolutfon picture 
lay be made to output. This is shown in drawing 1 (b) as a block diagram. In addrtionj as an image prck-up direction parameter, they are 
ie locations (camera height etc.) of an Image pick-up means, the angle (pitch angle) of the direction of an image pick-u|> core, and the 
traight line taken down downward [vertical ] from the image pick-^up means to accomplish, the angle (horizontal Bure angief) of thoae 
at surfaces to make^ and the diraotion of a setting image prck'<*up core set up to accomplfsK and angle of torsion of the image pnok-up 
Yeans centering on the dipectiotl; of an Image pick-up core. 

}D0€] ^4oreover, according to the means according to claim 3, in an image pick-up according to claim t or 2 and image transfbrmatlon 
quipment. it is oharaotertzed by attaching an image pick-up means In a car, and matnfy pioturizing a road surffefcoe. In additioHr a road 
urface is not limited to the so"^ called road, but means afl the fields where a car movesM That is, a paH^ing field is inciuded. 
3009] Moreover, according to the means according to claim 4, an image analysis means presumes and extracts the paralie! lines or the 
nown graphic form on a road surface, and is characterized by determining the amount of amendments of the image pi ck^ap direction 
arameter by analyzing the image pick'^up image or reaolwtion picture of these paraliefc Hues or a known g^phic form. Road aurface-lFke 
araiTeJ Ijnes mean th# road shOMtder, lane apace mark&, a parking field partition irn^ :eto.^ ai^ a known grai^ie form means road surface 
isppJay of a cireular mi^nhola, s stop line; anid atrw^ 

WI O] Moreover, according to the means according to claim 6, an image analysfe means ts characterizsed by determining the amount of 
mendments of the image piok-MP direction parameter by the rate measyrement means of a oar being interiooked with by analyzing the 
nage pick-up image or resoiution picture of an optical flow on a road surface. An optical flow means what is recognized by the image 
nalysis means as what moves in an image pick-~up imag^e or resolutron picture top here Jike the lane space marks of the shape of a 
roken line formed in the road surface. 

X)11] Moreover, according to the means according to claim 6, it has predetermined distance, two or more image pick-up means are 
rranged, and an image analysis means is characterized by determining the amount of amendments of the image pick-up direction 
. arameter by analyzing the image pick-up image of the image pick-up means of these plurality, or the resolutbn picture fay said Image 
•ansformation means. 

}D12] Moreover, according to the means according to ofaim 7, it is characterized by for an attltude^sensing means to d^ect the 
irection of an image pick-up means being arranged by the image pick-up means* using together the direction parameter of the image 
ick-up means against the car which this attitude-^sensing means detects, and determining the amount of amendments of the image 
ick-up direction parameter. An attitude-^sensing means means the combination and others of a gyroscope, an aooelerstion detector, 
id a computing element here. 
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The [1st ©xarnpie] Drewcng 2 is the block diagram showing the configuration of the imag^ p^lok-yp concerning the tst concrete exampfe ^ 
)f this Invention, and image transformation equipment ID. As shown in (a) of drawing 8 , it ts carried in Car M, and tha camera O which 
^otuHses car back a^sunned. Th^ camera of drawing 2 



32411 : tm/92/U : IB: DO 



:M0TI01S* 
j ?0 anil INPIT are not re^porisiMe for any 

{ .This documei^t has been translated computer So the translation m^y not \r^f\&ct the original pr«cl?Lejy. 
• shciw© tha word which can not be trarislated. 

j .In the drawirrgs. any word$ are hq^t translated. 



DESCRIPTION OF DRAWINGS 



0rlef Despnptfpft of the Or^wlng^l 

Drawing 13 The blook diagram expiaiwng th^ contents of olalm 1 of this invention, and claim 2. 
I Drawtrt^ 2l The btock diagram showmi^the corvBguratron of the tst concrete example af thf© invention, 
j Drawing 3] The flow chart which ^hows the procedure of the Is-t example. 

Drawing 4] The phyebai relationship Fig* for explajrilnjf the contend of an operation of. the 1$t exarvtjsie. . 
I Drawing 5] The pliysicai r^p^onship Pl& for expfainrhg the irvsH example. 

! 3rawinM 6l The conceptuaf diagram showing the image pick-up ihrtage for expfainlrtM the 3rd exanrofe. 

3 rawing 7] The conceptuaL diagram showing the image piok'^up image and bird's-^eye view image for explaining the 5th example. 

]>rawing[ 8] The explanatory view showing the of a pitoh angle when not amending, and the refation of a forrd's-eye view. 

■>eseHptton of Notations] 
i iCar 

VRo^aur^oe 

'c Camera pitch angle 

I The image pick-up 

' Tfie d^intira jrn^ge pibk-'^OR kriig^ of thet iisngfchWi se dfrecUori incorporated by the Wrd%^ey e view linage 
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